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This annual report is an evaluation of an adult basic 
education teacher training project at California State University in 
Fullerton in which 5 core courses and 10 elective mini-courses were 
offered to 25 participants who would eventually be certified as 
instructors and to interested inservice personnel in Orange County 
and adjacent areas. The principal thrust of the project was to offer 
practical courses in methodology of instruction appropriate to the 
needs of adults with limited . English-speaking ability and to those 
who are economically and/ or socially ' disadvantaged. Chapter 1 
describes the mod si for the program evaluation. Chapter 2 describes 
the overall plan for the project, including.a brief assessment of its 
acccmplishments as of the date of presentation of the interim 
evaluation report, January 15, 1976, Chapter 3 describes the program 
in action. Descriptions of core courses are given in detail along 
with analyses of the relationship of topics and other course 
components to the potential accomplishment of course objectives. 
Specific recommendations' are made in this chapter* Chapter 4 focuses 
on presentation and analysis of statistical data to discern the 
outcomes of the project based on 26 competencies which were 
designated as the specific goals of the project. Conclusions indicate 
that based on assessments of competencies at the beginning and the 
end, 22" of the 23 students who completed the program successfully 
attained the criterion level of performance. The appendix contains an 
illustrative course evaluation questionnaire, competency 
self-assessment scale, attitude scale, and instructor and course 
evaluation forms, (HL) 
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SUMMARY OF IHE REPORT 



The Teacher Training Project in Adult Basic Education is designed to meet 
the special needs of teachers in Orange County and adjacent areas, but the 
ultimate goal is to improve instruction throughout California as well. Core 
courses iind elect ives were offered for 25 participants ^^o would eventually be 
certified as instructors in ABE prograxns. In addition, in-service courses 
were open to all persoas who were interested in this field. The program was 
developed and established with the advice, cooperation, and active participa- 
tion of ii variety of cormiunity agencies,. Hence, although the program was 
officially based at California State University, Fullerton, in actuality it 
worked out and functioned within the setting of the broader cormiunity. The 
mcxiel for the program evaluation is described in Chapter I. 

The overall plan for the project is described in Chapter II. dn pages 7 and 8 
of that chapter, the reader will find a brief assessment of its accomplishments 
as of th(? date of presentation of the interim evaluation report, January 15, 
1976. Ii. was reported then, that (1) the program was successfully established 
and was functioning smoothly; (2) instructional needs which Vr^re identified 
were being satisfied through appropriate course offerings; (3) the issues\and 
problems which arose were being coped with through appropriai:e program modifica- 
tions. \ 

\ 



Chai)ter III describes\ the ABE program in action. Descriptions of core 




and other course components to the potential accomplishnient of course objec- 
tives.. Oa the basis of evidence derived from examining the coUrse outlines 



developed by the instxxictors , one may judge that each course is indeed a viable 

... ' ) 

■ o 



instructional medium. For most of the courses, the internal consistency of 
course elements was also examined from the point of view of students vAao par- 
ticipated in the program. In almost every course, virtually all responses were 
positive: stud^ts attested to the viability of the courses and the majority 
lndj.cated that they actually iinplanented learnings and skills derived from 
these courses within their ABE coui^s. The voluminous anecdotal data offered 
by students was generally positive and contained helpful suggestions for course 
and program improvOTent for the following year. Specific reconmendations have 
been made at appropriate places in this chapter. 

Chapter IV focuses on presentation and analysis of statistical data to 
discern the outcomes of the project. Ttxis important set of outcomes was com- 
prised of twenty-six corxpetencies which were designated as the specific goals 
of the project. Assessments of corpetencies at the b^inning and the end of 
the project were made, and based on the student self --ratings, it is judged that 
substantial gains were made toward attainment of the twenty-six corrpetencies. 
The participant self-ratings of achievement of conpetencies was also used to 
determine the degree to v^ich students found the 'program to be perscaially and . 
professionally valuable. Twenty-two of the twenty-three students v^tio conpieted 
the program successfully attained the criterion level of perfomance. In three 
of the four core courses v*iere pre and post tests were given by instructors, 
the group made substantial gains in average scores. The staff also made judg- 
ments concerning the degree to vAxich students attained the several ccnpetencies. 
In their judgment, most participants who completed the program successfully 1 
achieved the criterion level of performance. 1 

When students were asked to rate designated courses with respect to their 

I 

respective contribution of knowledge or skill, enthusiasm for the field, and 
personal and professional value, all of the courses were rated highly. In ' 

6 



addition, students were asked to indicate their feelings about designated core 
and mini courses. The participants reported highly positive feelings towards 
all of the designated courses. Student opinions about the value of Jspeakers, 
resource persons, filins and materials were also requested. Of the fourteCT 
educational experiences v^iiich were eva.luated, thirteen were rated as favorable. 

At appropriate points in the report specific reconrmendations liave beon 
made v^ich the staff may wish to review. In addition, two general reconnenda- 
tions are offered for consideration. It is su^ested that: 

1. The project staff meet as a group to discuss the project, overall 
■ as it is outlined in this document in order to see it as a total 

entity. 

2. The staff review the anecdotal information supplied by the partici- 

/ 

pants and weigh their implications for possible action. 
* * ★ * 

The successful corpletion of this project could only have come about 
through the hard work and cooperative efforts of the mentoers of a staff who 
are hi^ly dedicated to their professional responsibilities as educators. It 
appears that a portion of this professional corrmitmbat nay also have been ab- 
sorbed by their students. One conconitant side effect of the project is the 
high degree of professionalism as trainers of teachers ^^ich seems to have been 
generated among the participants. Virtually all have voluntarily indicated 
ways in v\tiich they might assist in the program for the following year and have 

\ 

expressed their readiness to perform a professional teacher education role. 
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CHAPTER I 



A MODEL FOR PRCX^AM lOIITORING 
, ANALYSIS AND EVALUATION 

The program of the Teacher TraiJiing Project tn Adult Basic Education was 
a unique endeavor to meet the instructional needs of persons who teach adults. 
This is a broad new field in which theory, practice and assessnent procedures 
have not yet matured to an aiivanced stage. Hence, ,. in the establishment of this 
program several unusual conditions were evident; specific objectives had to be 
formulated, courses had to be developed, participants were recruited and the 
program was put into operation under severe time restraints. Nevertheless, the 
staff vMorked diligently and met all deadlines, including those inposed by uni- 
versity administrative requirements. 

The evaluation sch(^ had to recognize the limitations which were set by 
time, resources, staff and participant recruitment and the several innovative 
aspects of the program. Therefore, it concerned itself primarily with expecta- 
tions which could reasonably be accompli<shed in one year. In addition, evalua- 
tion procedures sought to follow a pattern that muis't be utilized in other proj- 
ects of a similar nature where there are no standardized tests available and 
no way of making a connparative field of study under controlled conditions. Hie 
evaluation problem, then, was twofold: 

1. To identify and describe the nature of the program 

that was designed and implemented. 

2, To determine the degree to which stated objectives 

were achieved. 

A simple plan which was employed in monitoring and analyzing the results 



of the project enabled the entire professional staff, students, ccxisultants 
and representatives of outside agencies to become involved in the assessment 
of three asi}ects of the program: 

1. Input program plans, c e identif'ica- 
/ t ion of needs, fomm .n jtives and 

conpetencies, develi ^ . f arses, materials 

and fieldwork aXitivities, and the utilization 
of pers5onnel, facilities and caimunity resources. 

2. Program inplanentation, consisting of vAiat actually 

took place in the university classrooms and the 
fieldwork centers: the sets of activities, 
experiences, materials, resources and procedures 
enployed in the training of teachers. 

3. Outcomes, consisting of statistical and other evi-r 

dence of growth toward objectives:, the inpact 
of the training program on the teachers. ^ 

Each semester was considered as an assessment period: the Fall of 1975, 

the Spring of 1976 and the Sunmer of 1976 but there were just two formal 

.cycles of evolution. Since there were three assessment periods, a fourth 

cotrponent was added to the model. 

4. Assessment of procedures, activities and materials - 

as they- are formed, irnplemented in the program, 
and subsequently accepted, revised, or rejected 
in the light of experience. - « 

Ihe model may be presented in the form of a diagram: 



INPUT 




PKXJRAM 
IMPLEMENTATICN 



ouKxm 



PERICDIC ASSESSMENT AND REVISICN 



The- acceptance of the basic evaluation model established the friamework within 
viiich specific assessment tasks were set; These^ activities are given in Chapters 
II, III and IV. 



CHAPTER II 



DESCRIPTION AND ASSESSNENT -OF PROJECT OOMPCSqENTS 

Basic elements of the project 

1. Training needs 

The major assessment of training needs in ABE was acconplished prior 
to the funding of the project by surveying administrators, supervisors 
and teachers, but additional requirements were identified after its 
implementation. The principal training needs which the project seeks 
to serve are given below. . 

a. Principles of adult basic education (learning principles related 
to adult learners, qualities of successful ABE teachers). 

" b. Methods and techniques in adult basic education (for traditional 
schools, occupation and manpower pix>grams, etc.). 

c. The adult basic education student — life styles and coping skills 

(especially culturally different and linguistically different 
students). 

d. Teaching ESL (including teaching manpower — vocational— ESL) . 

e. Teaching basic math skills to adults. 

f. Teaching reading to adults (assesanent, methods and materials; 

functional level and developmental level). 

g. oFieldwork in teaching ABE to adults (applying knowl^dge by 

working in tutorial situation in field). - 

h. Teaching reading to the exceptional adult (handicapped, linguis- / 

tically different). 

i. Teaching GED. ^ . 
j. Establishing adult learninig centers. i * 

k. Bilingual teaching and the adult. 

1. Teaching consumer education. 

. m. Teaching jobology (how to get and keep a job). 

n. Leadership skills for the adult and group dsmamics. 

o. Conducting research in basic adult education (designing and 
conducting much-needed research; knowledge of resources). 



p. Teaching reading to the illiterate in his native language. 

On the basis of the needs which were identified, core courses and 
mini courses were then developed. These courses 'aro described later 
in the report. 

Broad goals and outcomes. 

Although, the project was originally designed to meet the training needs 
of ABE teachers in Orange Cc , it was modified at the request of the 
State Department of Educat include the areas of Los Angeles and 

long Beach as well. Th( ai\ aimensions to the program: 

a. Core courses and elective, lor 25 participants v*io were to be 

certified in ABE. The principle thrust of the project was to 
offer practical courses in rrethodology of instruction appro- 
priate to the needs of adults with limited English-spealiing 
ability and to those v*io are economically and/oi socially 
disadvantaged. To make the training available to teachers, a 
substantial portion of the budget was allocated to payment of 
both the cost of books and the total fee for core courses and 
electives for the participants. 

b. In-service courses vAxlch were open to all persons interested in 

ABE. For those persons working in approved ABE centers, the 
grant paid two-thirds of the registration fee. 

Structuring the project * • 

a. Staff recruitment 

Experienced faculty from the School of Education were available, and 
were recruited prior to the funding of the project on a tentative 
basis. Therefore, when the grant agreement was consunwated , plan- 
ning was iinnediately intensified. Additional teaching faculty 
were recruited from among experienced teachers and leaders in the 

^ field of ABE and they served as a vital link with the ofigoing 
comnunity program. 

b. Course development, schedule and facilities 

Courses were developed and offered during four time periods: the 
Fall of 1975, Intercession 1976, Spring of 1976 and Sumner of 1976, 
The schedule of offerings and their locations is given .below: 

FALL, 1975 

EI>-R 592 Principles and Methods of ABE (3 units) 

EI>-R 592A Teaching English a^ a Second Language (3 units) 

" to Adults 

,.>E[>:rEMX506Au...Jlater4alS'><and'-TeGhniques-'-^^ — ^ — 

Consigner Education to Adulti^ . - 

ED-R X506B Materials and Techniques in Teaching (1 unit) 

Conputational Skills to Adults 



ED-R X506C Establishing Adult Learning Centers 



(1 unit) 



Satisfactory facilities were found for all courses at California 
slate University, Fullerton but in order to make the learning 
setting more realistic arrangements were made to schedule classes 
at adult conmunity schools. For exairple, ED-R X506C was scheduled 
at the Learning Resource Cen cer at CSU? for one Saturday and at 
the Central City Occupational Center in Los Angeles on the second 
Saturday. Because of time constraints in publicizing the mini 
course ED-R X506B, the course was dropped as there was not suf- 
ficient enrollment 



INIERS: 1976 

ED-R X506i^' Leadership Skills and Group Dynamics 
for the Adult 
Offered at CSUF 

ED-R X5b6B Materials and Techniques in Teaching 
Corrputational Skills to Adults 
Offered at the Alamitos Adult Center 
Garden Grove ' 

ED-R X506C Establishing Adult Learning Centers 
Offered at CSUF and the.. Los Angeles 
Central City Occupational Center 

SPRING, 1976 

ED-R 5923 The Adult Ba^dc Education Student: 
Styles and Coping Skills 
Offered at CSUF 

ED-R 59Zr Teaching Reading to the ABE Student 
^ Offered at CSUF 

ED-R X5CoE Research in ABE 
Offered at CSUF 

ED-R X506H ABE Institute: Utilizing Performance 
Objectives in Teaching the Adult 

Offered at the Orange Adult Learning 
Center 

Orange 

ED-R X506A Materials and Techniques in Teaching 
Consumer Education to ^ults 
Offered at CSUF 

ED-R XSSL Teaching Reading to the Except ic«ial 
Adult 

Offered at the La Mirada Adult, Center 
La Mirada ' ^ 

SUMMER SESSIOT, 1976 

ED-R 592D Fieldwork in Adult Basic Education 

Offered at the Alamitos Adult Center 
Garden Grove 
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(1 unit) 
(1 unit) 

(1 unit) 



3 (3 units) 

(3 units) 
(1 unit) 
(1 unit) 



(1 unit) 
(1 unit) 



(3 units) 
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ED-R X506K ABE Institute: Administration and (1 unit) 

and Counseling in ABE 
Offered at the East Los Angeles 

Skill Center 
Monterey Park 

ED-R X506G Materials and Techniques in Iteaching GED (1 unit) 
Offered at the Chester Adult Center 
Ccfipton 

ED-R X506J Bilingual Teaching in ABE (1 unit) 

Offered at CSUF 

Selection of participant^^ Uiid biographical data 

Dissemination of information about the project was acconplished 
throu^ flyers, brochures, news releases, letters to professional 
organizations, and personal contacts. Forty-one applications were 
filed. In selecting the candidates, all 41 applications were re^ 
viewed by the project director, the project faculty, and the coor- 
dinator .of the Institute for Reading. Participants were selected 
ai the basis the following criteria: possession of the Bacca- 
laureate Derr^e, es^j^rience in an ABE program, background and 
quality of 3rie?s:ee and learfership potential. 

Twenty--seven per-sons vano were accepted into the program conpleted 
enrollment in-:,o tise University for post-baccalaureate studies 
and started -v^x- ^ courses. They came from a wide geographical 
area and repres^^r ed 12 school districts, including: Los Angeles 
lAiified, Con?3tan, Huntington Beach, Santa Ana, Garden Grove; South 
Bay, Corona, ^fScsntef/ello and Alhanira. Included were persons work^ 
Ing in regular* adult schools, occupational centers and rehabilita- - 
tion facilities. TTaere were 9 male and 18 female students; Ihe 
ethnic conpc ^:^ltion of the participants was: 4 Mexican-American, 
1 other Lati . 6 Bli^k, 1 Lebanese, 1 Asian, and 14 Anglo Americans, 
Thirteen haa ^. i^ter^s degrees or were candidates for Master's 
degrees in Qtb:er fields. ^ '-^ 

Coordination w:; i ccrmmity agencies 

The development ^ project was acconplished :^farough coojcdination 

and cooperat.^via wlzr several cormiunity agencies. The Presidents 
of two siste; /^ssnar-if^es of the California State Ifaiversity jat Long 
Beach and at -£>.^ Jdi^les gave peimission recruit participants 
in their respecr:r:rc5 student attendance areas. Adtalnist razors and - 
teachers in adult education pi;Dgran]S responded to the questionnaire 
which assisted tie rtjject director in identifying ABE tether 
training needs. AOTunistrators of Aduiy Education and Oomunity 
Centers in Orange and Los Angeles Couivties have offered theit- 
facilities for ^^^chestuling classes and^for fieldwork. Presentations 

-_£^.-.^5..]J&Xg-.]2eeii xs^^ h^^X^^'-^-t^^ei^^ — 
sional organizaTioris. In this last respect, most participants of 
the ABE prr^aro ha^*^ joined the California Council for Adult Educa- 
tion, and part - ^ip^ts served on the prc^ram of the OCAE South 
Coast Section annusa convention. 
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Oae of the most iinportaiit ways of ensuring the professional assis- 
tance and cooperation .of a variety of adult educators in comnunity 
agencies was through the formation of an Advisory Cannittee to the 
ABE Iteacher Training Project. The 10 rrennber cormuttee perceived 
that its priJiciple function was to advise the project director in 
matters relating to program objectives and. implementation. At its 
meetiags of September 10, 1975 and January 7, 1976 the cotrmittee 
gave consideration to the goal of working with the University to 
establish a full graduate program in AEE leading to the Master's 
degree. At the meeting of January 7, 1976, it. was generally agreed 
that the project director and advisory commttee should be concerned 
primarily with establishing a quality program. The advisory com- 
mittee would support the development of a Master's degree by the 
university. The p3X)ject director has convened meetings with rep- 
resentatives of several groups to develop a Master's degree program. 
MeetiJigs involved School of Education faculty and Dean Robert T. 
Stout; the Director of the University Continuing Education prograrii;. 
and Dr. Roger Axford, Consultant in Adult Edu6ation from Arizona 
State University. ^ . 

Assessment of project elements ^ 

1. Identification of issues, probleiis and subsequent program modifications 

a. Instructional . , 

A siurvey among participants at the beginning of the program revealed 
that they expressed the following course needs; , 

1. Teaching reading to adults who are illiterate t 

iJi their own language. 

2. Administration and counseling of the ABE student. 

3. Writing objectives ^in terms of behavior. 

Prograxn modifications to meet these needs have already been made. / 

b. Mini course publicity 

In order to condensate for the low enrollment in courses ED-R X506A 
and ED-R X506B which was caused by the tima restraints in getting 
the program under way in September, 8,000 flyers were distributee^ 
to publicize future mini courses. 

a. Administration 

The project director and staff have successfully performed their 
administrative ftinctions but they j^re han 

^*'fl5of 'S^ Tfh addition, 

there was extensive noise in the project director's office be- 
cause the sams anall room (normally a "onenreui" office) was 
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shared with the clerical assistant. It was recannended that 
conversations with the appropriate officials be initiated to 
try to alleviate the situation. 

2. Evidence of internal consistency of elen^nts 

After a relatively brief period of tiine in operation, the teacher 
training project at California State University,; Fullerton has: 

a. Identified needs in a variety of ways 

b. Inplemented these needs - in' course offerings ! 

c. Provided for continuous evaluation by iistructors and staff 

In addition, the staff has 1) invited comnents and suggestions by 
inside and outside sources and 2) utilized the assistance of an 
advisory comnittee in policy deliberations. 

/ 

Overall, the project is functioning effectively. Comrents and suggestions for 
inprovenrjent have been brought to the attention of the project director and 
several modifications have already been made in the program. 
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CHAPTER III 

THE TEACHER TRAINING PROGRAM IN ADULT BASIC EDUCATION 



Description of the program implemented ' 
In the previous chapter a description of the overall design ana^ 

zi-itiation of the project was given, together with a general assessment 

I 

of the overall program.. In the present chapter, attention will focus on 
the components of the program which were actually inplemented. In order 
t ) cope with the training needs v^iich were identified and presented; in 

Cnapter II, the faculty committee in formulated sets of specifics 

i 

competencies in corisultation with teachers and administrators who were 
currently responsible for conducting i3E programs. The conpetencies 
served as the objectives of instruction vathin <;ach course. The more 
basic competencies were, included within a set of core courses consisting 
of 15 units, vfeile others were allocated to the group of elective couilses. 
Descriptions and analyses of the several courses will be presented by 
year and by semester in which they were offered, - \ 

The several sets of competencies, the course descriptions, and the 
elements within each course that were designed to promDte growth toward 
the appropriate conpetencies are given below. ^ More intensive analysis 
will be made of the core courses because of their greater allocation of 
un±ts of credit and hours of instruction. The courses offered during 
the fall semester of 1975 will be presented and examined first. 



ADULT BASIC EDUQATIOI PROJECT 



CORE COURSES 



. 592 - PRINCIPLES AND METmODS OF ADULT BASIC EDUCATION '3 units) 

i^araiag principles, related to adults; aBa].ysis of vanious methods and 
techniques in teaching basic education oixrses to adul:z3; utilizing 
resources available to the teacher of actult basic education. 

The student will: 

A. Demonstrate his abilitj to explain the basic psychological laws 

affecting the adult learner. 

B. Demonstrate that he can identify the characteristics of the 

adult learner . 

G. Demonstrate his ability to analyze the strengths and limitations 
of various methods and techniques in teaching basic ediication 
courses to adults. 



D. Demonstrate his knowledge of professional organizations and 
resources available to the. teacher of ABE. 



Topics 


included in course: 




1. 


Overview, Competency Quiz 


October 1 


2. 


Base-Line Inventory, Instructional Strategies 


October 8 


3. 


vNature of the Adult Learner 


October 15 


4. 


Adult Basic Education Curriculum 


. October 22 


5. 


Reseaj:*ch Literature and Philosophy 


November 5 


6. 


Program Development 


Noven4)er 12 


/ . 


Professional Organizations 


November 19 


8. 


Psychological Principles 


December 3 



Other course corrponents: 



References in the text are chosein by conmLttees of three persoas. 
They are responsible for surveying the materials for one session 
and provide at the previous session such textual references as 
are needed for study by other students. 
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10. Materials 

Text: Materials and Methods in Adult E ducation, IQevins 

Subsidiary Text: leaching the Culturally Disadvantaged , 
Lanniiig and Many 

11. Practices 

Students are to organize short teaching segments to be presented 
utilizing several teaching methods. These will be presented on 
the following schedule. 

October 15 1-4 
October 22 5 9 

October 29 10 - 14 

November 12 15-19 

November 19 20-24 

December 3 25 - 2G 

12. Resource person 

November 5, guest lecturer, Mr. Chester Klevins, presentation of 
the material scheduled for that evening. 

ANALYSIS: 

In order to clarify and demonstrate how the elements of the course, 
ELV-R 592 are inter-related, information concerning its goals, content, 9jnd 
procedures, including topics" for observation and other course conporisnts, 
axe pi^sented succinctly below in Chart A. An examination. of this chart indi- 
cates that for each competency that is identified as a course objective, there 
are one or more topics and other course ccsponents that are devoted to its 
potential acconplishiTient . 

CHART A 1 . 

Competency Topics Other Course Connponents 




^'C T 1 9, 10, 11 

3, 5, 1 9, 10, 11, 12 

9, 10, 11, 12 



2, 4, .6, 1 
4, 5, 1 



11 22 



9, 10, 11 



EI>B 592A - TEACHING ENGLISH AS A SECXM) LANGUAGE TO ADULTS (3 units) 

Methods and materials for teaching English to adult speakers of other 
lajaguages; constiiaction of teaching units and lesson plans; reading 
and writing in ESL; evaluation techniques, and resources. Includes 
instruction in Manpower ESL. 

The student will: 

A. Demonstrate that he can describe the English sound and syntactical, 
syston as it relates to the adult learner with an ESL background. 

Demonstrate that he can assess, plan, implement and evaluate a 
program designed to meet the needs of the adult ISL student. 

Demonstrate the ability to identify, select and evaluate resource 
authors, texts, and periodicals in the ESL field. 



B. 
C. 



Topics included in course: 

1. Orient at ion /Course information and requirements 
Bibliography, professional organizations, journals 
Understanding the adult ESL student 
Constructing the Lesson Plan 

2. Caning the ESL lesson 

■ - Hearing and producing the sound system 
Guest lecturer: pr. J. Kiraithe 

3. PTesenting new material (hearing and speaking) 
i!^anpower ESL 

,4. Presenting new material (hearing and speaking) 
Reading and writing in ESL 
^lanpower ESL 

5. Evaluation in ESL 
Textbooks, audio-visiial aids 
r Observation report due) 

6. Supplementary materials in ESL 

Guest lecturer: Dr. Harry Huls, San Diego State 
(Conference report due) 

7. Closing the ESL lesson 
Final examination 
(Book report due) 

Other course conponents: 

8. Siig^ested readings 

9. Grcup activity and drill work ^ 
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October 4 

October 18 

October 25 
Nbven]ber 1 

November 22 

December 6 

December 13 « 



10, 

11. 

12, 



Book Report 
Observation Report 

Attendance at professional conferences 

a. Orange County Reading Association 
Disneyland Convention Center 
Anaheim, California 

b. California Reading Association 
Fresno Convention Center 
Fresno, California 

c. California Council For Adult Education 
(Southern Section)' 

Foothills' Adult Education Center 
El Cajon, California 

d. California Association of Teachers of English 

to Speakers of Other Languages 
California State University, Long Beach 
Long Beach, California 

e. California Council For Adult Education 
(South Coast Section) 

Holiday Inn 
Ventura, California 



13. 



October 11 



November 6,7,8 



November 7,8,9 



NovOTber 7,8,9 



November 14,15,16 



October 18 
Decenfeer 6 



Resource persons 
Dr. Jacqueline Kiraithe 
.Dr. Harry Huls 

ANALYSIS:' ' ' 

Pertinent information concerning the inter-relation^hip of elements within 
course EI>-R 592A is given succinctly in Chart B. An examination of Chart B 
reveals that for each conpetency that is identified as a course objective; 
there are one or more topics and other course con?>3nents/ that are devoted to 
its potential acconplishment . 
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CHART B 



^^^°f^tency Topics other Course Coiponents 



A 
B 

C 



2, 1 
1, 3, 4, 5, 7 
5, 6 



8, 9, 12, 13 
8, 10, 11 
8, 12, 13 



Two elective courses were also offered during the fall sanester of 1975: 
ED-R X506A and ED-R X506C. The elements of the ED-R X506A course are given 
below {m~R X506C will be discussed later). The course is designed to focus 
on a single conpetency; and hence the inter-relationship of course elements 
is evident. 

ELECTIVE OOURSES 

ED-R X506A - MATERIALS AND TECHNIQUES IN TEACHING CONSUMER EDUCATION TO ADULTS 
"(1 unit) 

Helping the adult to handle money wisely, to evaluate advertising and 
claims made for products, to avoid legal traps, and to know his l^al 
rights as a consumer and as a citizen. 

The student will: 

Demonstrate that he can develop methods and experiences for adults 
wtaich will explain family money management, related to his rights 
as a consumer and as a citizen. ' 

Topics included in course: 

1. Orientation 

2. Consumer Protection 
:3,. Marketing.., <■■- — .„.. - — , — 

4. Money Management - Introduction 

5. Credit - ., 

6. Specific Consumer Areas - Introduction 

7. Family Health and Safety. 
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other Course carponents: ' 

8. Selected readings, Consumer Education materials 

9. Student presentations 

10. Demonstrations 

11. Small group work 

12. Resource: Guest speaker 

13. Activity, evaluate consumer informatibn sources 

14. Develop plan for a Consumer Education ^course 

During the intersession, 1976, three elective courses were offered: 
ED-R X506F, ED-R X506B and ED-R X506C. The el^nts of each course are 
given below. Since each course is designed to focus on a single competency, 
the inter-relationship of course elements is evident. 

ED-R X506F - LEADERSHIP SKILLS AND GROUP DYNAMICS FDR THE ADULTS (1 unit) 

Survey and practice of group interaction and roles in problem-solving; 
influence of values and body language in comnunication; and development 
of techniques to improve leadership skills, as related to teaching adults 

The student will : 

Demonstrate that he can identify, inplement, arid evalxoate techniques 
for teaching group dynamics and leadership slcills to ABE students. 

, j - r> 

Topics. included in course: | 

1. Group Dynamics ' . 

2. Roles of Group ^^embers 

3. Steps in Group Problem-Solving 

4. . Leadership 

5. Values 

6. Body Language 
Other course ccrponents: 

7. Readjjig in selected references 
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8. Instructor prepared materials 

9. Audio-visual rriaterials ' - 

10. Group discussion 

11. Sinxilation activity 

12. Small group wnrk 

ED-R X506B - MATERIALS AND TECHNIQUES IN TEACHING CXM>UrATICNAL SKILLS TO ADULTS 
(1 unit) 

r 

Methods and materials in assessing the basic conputational skills of 
adults and developing individualized instructional plans for teaching 
the needed skills in ways which relate them to daily survival and 
vocational needs. 

The student will: 

Demonstrate that he can assess the basic conputational skills of 
adults and develop individualized instructional plans for teaching 
the needed conputational skills in ways which relate these skills 
to daily survival and vocational needs. 

Topics included in ccairse: ^ 

1. Taxonomies :of Conputational Knowledge ♦ . 

2. Development of Instructional Materials 
' 3. Strengthening Corrpetencies in Students 

4. Self-assessment 
Other course corponents: 

5. Practicum 

6. Sirrulated teaching 

7. Use of special ABE training mterials , 



ED-R X506C - ESTABLISHING ADULT LEARNING CENTERS (1 unit) 

Methods of establishing, operating and evaluating adult multimedia, 
individualiised learning centers; othe role of the instructor in 
individualized adult basic education instruction. 

Ihe student will: 

Dearonstrate that he can establish, operate and evaluate an adult 
multimedia, indivixiualized learning center. 
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Topics included in course : 

1. Use of Learning ^Ctenters and Other Individualized Materials 

2. Principles of Individualized Instruction 

3. Developing a Learning Center / 

4. Role of the Teacher in Individualized Instruction 

5. The * 'Learning Packet'' 

6. For Individualized and Using Learning Centers: Planning Class^ 

roan Time 

7. Considerations Regarding Purchasing Audio-Visual Equipment 
Other course corponents: 

8. Selected readings ' * 

9. Field trips 

10. Demonstrations . ^ 

11. Task group development of instixictional units 

12. Learning Center Activity 

13. Resource: Guest speaker 

During the Spring semester of 1976, two core courses and four elective 
courses were offered: ED-R 592B, ED-R 592C, ED-R X506E, ED-R X506H, ED-R X506A 
and EE>-R X506b. The two core-courses will be preisented and analyzed in detail, 
while the elements of the elective courses will be presented in outline foim. 
The course ED-R 592B will be discussed first, 

PORE OOURSES 

ED-R 592B - THE ADULT BASIC ED STODENT ^ UFE STYLES AND COPING SKILLS (3 units) 

.'^Assessing and planning instruction for the unique needs of the linguis-- 
tically and/or culturally different adult; developing instructional 
materials related to his life styles and coping skills; assisting the 
adult basic ed student in develop ingv techniques and resources needed 
for growth. 

28 ■ . ■ 
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The student will : 

A. Demonstrate that he can assess and plan instruction based on the 

unique needs of the linguistically different, culturally 
different and/or the economically disadvantaged student. 

B. Demonstrate that he can adapt and develop appropriate instruc- 

tional materials related to the life style and coping skills 
of, the individual ABE studait. 

C. Demonstrate the ability :o assess ABE students in self-analysis 

appropriate to his life styles and coping skills and in develop- 
ment with the student of techniques and- resources needed for 
growth. 

D. Demohstrate that he can design evaluation procedures needed to 

show individual growth and progress development. 

Topics included in course: 

1. Needs and Life Styles of Linguist ically-Culturally Different 

Students 

2. Coping Skills Relevant to those Needs and Life Styles 

3. Orientation of Ccxitent Course to those Needs and Life Styles 

4 . Resources 

5. Techniques 

6. Adaptation and Development of Instructional Materials 

7. Evaluation and Odgoing Inprovement of Techniques ahci Materials 
, Other course, components : ' . 

8. Textbook material: Teaching Survival Skilis in Adult Basic 

Education , Camper • v . 

9. Attendance at Reading Institute ''Game Day'' to assess potential 

use of techniques with adults. (2/28/76) 

10. Attendance at CCAE Convention, North Hollywood. (3/13/76) 

11. Resource: Larry Fidier, Project Director, Literacy Volunteers 

of America 

ANALYSIS: " \ . 

Pertinent information concerning the inter-relationship of elements within 
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coui'se ED-R 592B is T^en succinctly in -Chart C. An examina~on of Chart C 
reveals that for eacii zr-npetency th'^K is ident :ied a. a cours- 3. 'rr^tive, 
tj;- -»-.T e one rrc:— - t. ries and oth .itf' "aipone::ts that e-'oted rc 

itc x)tential ac-2aTr . -stor. i. 

CEART C 



Connpetency T opics Other Cjui '^ ^e CofPC'iraenxs 



A 


1 ^ 3 


8, 


. 10. 


11 


B 


2, 4, c 


8, 


3, 10:, 


11 


C 


1, 4, 5, 7 




8, 10 




D 


7 




8, 10, 


11 



ED-R 592C - TEACHING RKADING TO THE ABE STUDENT (3 units) 

Analysis of the causes of reading problems in the adult basic education 
student; assessment, diagnosis and prescription of the reading needs of 
adults ; analysis of current research in the field of teaching reading to 
adults. 

The student will: 

A. Demonstrate that he can analyze and describe the causes of 

adult reading problOTS. 

B. Demonstrate that he can assess, diagnose, and prescribe the 

reading needs of adults at the basic, functional and develop- 
mental levels. 

C. Demonstrate the ability to evaluate, select and organize 

facilities, materials and equipment in an individualized 
reading program for adiilts. 

D. Demonstrate knowledge of resource authors, texts, periodicals 

and ^professional organiz<9.tions in the field of teaching 
reading to adults. , • 

Topics included in course: 1 

1. Etiology of Reading Problems of the ABE Student 

2. Diagnosis and Prescription . 
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3. Assesanent 

4. Evaluation . -m" : -rthods of Teaching Iteadir. to the ABE 

Stuiait 

a. Character. .cs^ arious Reading Progrsirs 

b. Strengths -ar \ L--^rations of Each 

5. Individualizec: ■ rograms:: Curriculum Materials, Audio- 

visual Equicci^.-"^ . ntrziTairmed Materials, I^ilities 

6. Research Techr, 

a. Recognizln rs, Texts, and Journals 

b. Using Reso . --^^ j , Professicxial Growth 
Other course conponents 

7. Textbook materl : "trategies in Adult Basic Education , ifengano 

8. Research and pr^- xrjarion of an oral report (individual or group) 

on a topic seiecrted. form the course curriculum. 

9. Attendance at one or T^re of eight possible professional 

(ionferences recrnxoeGded by the instructor. 

10. Presentation of a ^Titten sumary of the sessions attended foi* 

at least one conference. 

11. Guest speakers 

Robert Ehlers, Etai3 department cf Education 

Dr. Jo Ellyn Tayi—. I— ject PEARL, San Francisco 

ANALYSIS:, 

Pertinent information concerning the inter^relationship of elai^nts within 
course ED--R 592C is given succinctly in Charr D. An examinaticxa of Chart D 
reveals that for each canpetenicy tnat is identified as a course objective, 
there are one or more topics and otiher course coiponents that are devoted to 
its potential acconplisfament. 
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CE^iBT D 



ODTi^Detency 


Tt^pics 


Other Cour== C.Mpon&a.tz 


A 


L, 6 


7 3 
'J * 


3 


2, 6 


7, 8.. e a 


C 


3, 4, 5, 6 


7, 8, 9 -1 


D 


4, 5, 6 


7, c - 



Four elective courses were also offered during \he Spring s&rEz:::eyr of 

1976. One of the courses, ED-R X506A, has already been presented. Tne elements 

of each of the three courses that have not yet been previously described are 

given below. Each course is designed to focus on a single conpet^cy; and 

hence the inter-relationship of course elements is evident. 

ED-R X506E ^ RESEARCH IN ABE (1 unit) 

Participation in seminars related to student and/or instructor-sponsored 
research in ABE; designing and conduct±ng research projects; interpreting 
and evaluating current research in ABE. 

The student will; 

Demonstrate his ability to interpret current research in ABE and 
design and conduct a research project related to current trenc^^ 
and projected research needs. 

Topics included in course: 

1. Discussion of Student and/or Instructor Sponsored Researct 

2. Research Methodology 

1 3. Research Project Proposal 

4. Participation in Research Projects / 

5. Presentation of Progress Reports - 

6. Evaluation of Research Activities and Plans for Follow-up 

21 • ■ 



ED^R X506H - AZJIL BASIC ZDUCATION TFJ\IN. INSir'TJTl- UTIUZING FERKS^. "Tl 

CBJEirmiS 1 unit) 

Utilizing psr^rDimEnrize objectives in . achinr •.qlx:3: using an ins-:.::r :ioaal 
sequeuce; wr .lug zr-jgraxn objecrrives ^elecTJ:-:^^ -ne^hcxls and mater:..^- or 
achieving oh. ri>zzz^^; developing and lollowriue e course ouxline; ^inc ; ':e of 
pre and post ^est: zo doDonsrrate achievongrz. 

/ Ihe student —HI : 

Denionstrrxe corpetency in utilizine perrciroancs objectives in teajzciing 
adults 

Topics inclucsd in course: 

1. Developrrent of an Instructional Sequence, and Utilizing Saime. 

2. Developmoit of Program Objectives vfeich are Measurable. 

3. Selectic^ of Merbods and Materials tc Aid in the Aciiievemsnt ci 

thir Purpose arl Objectives. 

4. Developing and Following a Course Outline and Lesson Plan. 

5. Evaluating Inprovement by Pre and Post Testing. 

ED-R X5jI^ ^ lEAOUNG READING TO EXCEPTIONAL ADUL3S (1 unit) 

Understanding the unique problems of ABE learning disabled and physically 
handicapped students; assessing, diagnosing and prescribing for the reading 
needs of these persons, using appropriate techniques. 

The student will: ^ i 

Denionstrate that -iie undersu^ds the unique problems of ABE physically 
and mentally hazadicapped frtudents and th^.z he can assess, diagnose 
and prescrire for the reading needs of triese persons using appropriate 
tecbniqiiss . 

Topics included in course: 

1. The Ctaracteristics ai Sxceprional Adult Students 

a. Leamijig DisabLsd 

b. Ph^'sicE-Ily Handicapped 

2. Learning Operation 

3. Diagnostic Instruments 

4. Learning Styles 

5. Reading Methods 

33 
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6. C .rr^rr: .li Materials 
' . :e: ^ Development 



During ite SuriBrr - sslon of 1976, tn^ * .nal set of courses were offered: 
- core ccLirse, EL-: JilT and three ele::tr- 3> ED-R 506K, ED-R 503G, and 
X5C6J. Tie c :urse will be presented and analyzed in detail. 

-R 592D ~ ?iEmvr:i: :: „-j)ult basic edi:ca~ J^^ (3 units) 

Field * rk in ■ g, di.^-.^;nosing , r ^ning and iiralementing a progr'am 

for ac „,ts in V;ad:_:::: ESI or corrputar: :nal skills; designing and iriple- 
menting inser\_-3 prccedures in adult I. ^ic education. 

The student wil^: 

A. Demonstrate tris^t he can synthesize the knowledge, training and 

experience from the core courses in this program and develop 
furt:sr prcfessional e?qpertise by using them eff^tively in 
a fitldwori: situaticr.. 

B. DefmnsT:rate ubat he csld design iirplement and evaluate inservice 

ii: ::r^^ relate to the VHxious groups affected by and affect- 

lis program, such as students,., .aides, teachers and adminis- 
^zn.- ors. 

C. Dermstrate that : e can -nzierstand and interpret the ^^^rmat and 

individual corir^ nents ^ AEE project proposal. 

Topics -*.nc^*-..:ied ir. course; 

1 . .:T:^ii.ta^-.on tc FieUd Lit - 
iS:-.- .cnnisr : to InsTruc^icn 

3. AS;.-r ::^m6£: : : Str^snirths ^" .a IdJt— ations of the Leamer(s) 

4 . De.:::i:r zr: an Instrocrri-onaJ. Sequence 

5. Insz':T^tz.c:n in tirs: Spec-, ic Field 

6. Professional Log-writing of Observations and Experiences 

7. Designing Inservice Programs 

8. InplCTen^ation of Inservice Prcgrams 

9. Evaluation 



Ouiier course connponents: 

10. Te:::tbooic materials: Last Gsmz. ? c Bducati^on , Ifezirow, er^/al. 
Test s of Punctional Achxl- Li^zerc;:- , Northwest Bagiona] Zducf- 
tion Laborarory 

11- ODrrpletion of a daily log f ..v^erk experiences, incl'uding a 
siOTTttT}' evaxaaxion 

12. Presen-iiatiDn of an iaser^^.ce pl-zi cr grant proposal 

13. Evaluarioas of -inservice piaas giuut proposals 

14. Guest i^-^akers : Marianne Woods: CSUF, Proposal ?/ritit3g 

HiaiHS Jolnnsoz Administrator La Puente Valley 
Adult £ hool 

ANALYSIS: 

Pertiaent infoircation concerning tae irnrer-relationship ot ccurse elements 
with course ED-R 592D is given succinctly in ::-iart E. Ar: examinarion of 
Chart E reveals tliat for each canpete:::r:3?' tha^ Is identified as a ccurse ob- 
jective, there are one or mere zoplzs ind other course corEXHienrs tnat are 
devoted to its potentxJil a.cocfipll3hme:\ 



Ccnroetency 


Top. 3 


Otlier Cburse Ztapcments 


A 




10, 11 IZ. 


B 


,4, 5, 8, 9 


10, 11, 12 


C 


- 


13, 14 



El-R X506K - ADULT BASiZ EDi'oCATIQ; TRAINING INSmun; TCS ADMINISTRfi^iae M) 
OOUNSEDOTC (1 un-- -. 

An Institute for ag n : r d.srrators , counseiza^, and teachers of asult : asic 
education; util ir n nn eKetralary practices :dn axininistering ABE: counseling 
the ABE student; financing the ABE program. Speakers and disc'^ion leaders 
frcm the State ^Dsjartment of Education and coiinunity ABE centers. 

■, A., ■ : . • ■ 
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The student will: 

Danonstrate that he can identii: ioxenplary pr:Lct:^ces in acminz^terlng 
ABE, evaluate cx)Uiaseling techniques for the AEE student, anc 
establish criteria for financing the ABE przzt-ani. 

Topics included in course: 

1. Exenrplary ProgranrB 

a. Developing Criteria for E^eloping Exer? :ary Practices 

b. Identifying Ex^iplar^; ari Promisizig Prac:rices in AES 
. c . Validating Practices I^ms idered E^iiarpliu^/ 

;d. Establishing a Syster of Dissenoinaticrjin r: ' Such Praccicas 

2. Counseling the ABE Studoat 

a. Establishing Criteria ror Evaluatir-:^ Ccj-i^lzxig ''Hecir.i.aues 

in ABE 

b. Ihe Role of the ABE Ca^g^elar- 

c. Special Problems 

3. Financing the AEE Program 

a. Iftiderstandiag Legisiatijr. /'^-r^.t i ^^r .Hr^g of 

b. Action-oriented Admin isr - rrion of iSBE Prrcrains 
Cfeher course conponents: 

4. Speakers: Dr. Roger Axford, ?rofessiCT.r..:^izazion ir: Acult Education" 

jurrent Issiebs In Adult E<xiio^: Aon" 
John Caliper ''EsBsxsolary Programs? ir .SHE'' 
Dr. Robert C-^^k: . ".zrr^xz Zssi^ jt: Fingncr^g _iL::ult , 

EoLLcarion mr, Irgpllcat. oil for ABE** 

5. J Panel Disciassion: Robez^ Eieggnr, Wy^nrr Pere^, Ixpe Si 'rssQn, 

^'Counseling in MaLz .Sasic: Education 

6- Reaction Groups, Discussion with the Espert^ 

ED-B JS06G - MATE3UALS AND TEX3INIQIIES IN TEACHIMJ GED (1 -imit) 

Identifying, selecting and evaluating mate ri als user.: to prepE>^ bxzi1±s 
for the General Education DevelojOTent test; f jeJdwar::: in utili::±ag 
ccnpetencies gained in the coaTse^. 

3:1 
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The student will: 

Demonstrate that he can Identify, select and evaluate materials used 
to prepare adults for the General Education Developnent Test. 

Ibpics included in course: 

1. The (2D Examination and its Sub-sections 

2. Besources for GED 

a. Performance Resources 
3. Cognitive Besources 

3. Student Evaluations 

a. forms 

b. Self-rating Scales 

4. Stu££ent Self Instruction: test booklets, stuay labs, brush-up 

sessions 

ED-R X506J - BILL.NGUAL TEACHING IN ABE (1 unit) 

Assessing thje linguistic competencies of the bilingual adult learner in 
his native language; understanding the background factors related to his 
basic educational needs; and inplementing a program of teaching which is 
based on his existing linguistic and academic cai5)etencies . 

Hie student will; 

DemcMistrate that he understands the background factors related to the 
basic educational needs of the bilingual adult learner and that be 
can inplement a program rof teaching that will meet those needs. 

Topics included in course: 

1. Assessing the Linguistic Conpetoicies of the Bilingual Adult 

Learner in his Native Language 

2. rftiderstanding the Background Factors Related to his Basic Educa- 

tional Needs 

3. Developing a Program of Instruction Based on the Linguistic and 

Academic Oonpetencies of the Bilingual Learner 

Other course conponents: 

4. Written Project on Special Ibpics ' 
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Assessment of Program Elements: First Cycle of Evaluation 

In the previous section of this chapter, a description was given of 
the program conponents wdiich were actually inplemented. Whereas section 
A answered in detail the question, ''What teacher training program was 
created", the next section will seek to deteimlne how well the program 
functioned in reaching its goals. Judgments will be made about how well 
the course objectives (or conpetencies) were linked to the broad goals of 
the program and how well the course activities were linked to the conpe-- 
tencies. In addition, judgments about the quality of the program elemants 
will also be made. Finally, some statistical data will also be presented, 
although a full statistical analysis will be reserved for presentation and 
discussion in Chapter IV. ' 

During the Fall Semester of 1975, the following courses \rere taught: 
EI>-R 592 - Principles and Methods of ABE 

EE>-R 592A - Teaching English as a Second Language to Adults 

ED-R X506A - Materials and Techniques in Teaching Consumer Educa- 
tion to Adults 

EI>-R X506C Establishing Adult Learning Centers 
The first cycle of the evaluation process is focused principally- upon 
these courses which were taugjit during the fall time period. It was 
anticipated that information generated during this first examination of 
the program would serve ajs a basis for further program modification during 
the Sprxng Semester. 

Judgments about the internal consistency of program elements will be 
presented first. In addition to the descriptions of courses given in the 
previous part of this chapter, Section A, analyses were also made of the 
two core courses, ED-R 592 and ED-R 592A. The piar^ose of the analyses was 
to discern . the extent to Vfixlch program goals , course conpfetencies , and^ 

38 ' 
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course cont^t were adequately inter-related. On the basis of evidence 
derived frcxn examining the outlines developed by the instructors, one 
nay judge that each course is indeed a viable instructional roediim. 

The internal consistency of program elements, and their quality, may 
also be examined from the point of view of the students ^o actually par- 
ticipated in the courses. At the termination of each course an evaluation 
form was conpleted by participants. The foim described the broad goals of 
the project and also listed the ccnpetencies vrtiich each course was designed 
to achieve. Four questions were asked and participants were expected to 
check a given response and then provide an appropriate explanatiOT. In 
this manner both the direction of response, positive or negative, and the 
individual's ratiaaale would be supplied. A talley of responses is given 
below in Chaxt F. A copy of the form is found in the appendix. 

An examination of Chart F reveals that for both courses, and for each 
question, the students' responses were overwhelmingly in the affirmative. 
Hiey report that the corpetencies were lexically linked to the course goals, 
and the instructional conponents and evaluation procedures were well suited 
to promoting growth toward achievement of the corpetencies. Virtually all 
participants Indicated that they were able to inplement in their respective 
classroom information, skills, and materials and procedures wftich they had 
derived from these courses. 

A wealth of anecdotal data was derived from the written statements 
which students also provided as a rationale for their decisions. It is not 
feasible to quantify this informatiai, but the tone of these responses was 
extronely positive and very enthusiastic abcxat the quality of the general 
program elements. In addition many potentially helpful and useful suggestic»s 
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were offered for possible course imErDvernent . Negative coiraents were rare. 
Althcoigh onl a few students did no*: put their names on these evaluation 
forms, it di not appear "r::at their raiments were less positive than those 
vAio did. Ihe. rather lar^^ voliome of infoimation sipplied by students ap- 
peared to be genuinely czieir-L to their instructors as approbation for 
their efforts. 



CHABT F 



Perception by Students of the Iniamal Ccnsistency of Elements. 


Tally of re- 


spouses b' ccursre. 




1. Are the course conpetencies related to the broad goals of the project? ' 


ED-R 592 Yes 24; No 1 No, respcxise 


0 


or unclear 




ED-R 592A Yes 22 No 1 ^ Ifo response 


0 


or unclear 




2. Was tiie instruction related to the competencies 




ED-R 592 Yes 19 m 3 No response 


2 


or unclear 




ED-R 592A Yes 24 No 0 Ifo response 


0 


or unclear 




3. Were zme evaluation procedures used in the course related to the cotrpetencies 


and goals of the prop^am? 




Eli-R 592 Yes 21 No 2 No response 


2 


or unclear 




ED-R 592A Yes -i:^ No 2 No response 


•1 


or lonclear 




4. In your teaching, have ya::: been able to implement the instruction that you 


received in this course? 




ED-R 592 Yes 20 No 1 No response 


3 


or lonclear 




ED-R 592A Yes 22 No 0 No response 


2 


or unclear 





40 



ERIC 



In order to obtain baseline data concerning the level of acconplish- 
ment of the participants in the ABE program at the time of their entrance 
into the beginning courses, students were asked to coiplete a self-^assess- 
ment instrument. The items ou the instrument consisted of the sets of 
competencies identified by the staff, and for each item, the participant 
was asked to rate his level of ability on the^ following 'five point scale: 
Not Competent g ^ ~ Highly Oonpetent 

At the end of the fall semester when students corpleted the two core courses, 
ED-R 592 and ED-R 592A, the participants again assessed their own level of. 
accoiplishnent on each itan. The results are depicted in Chart G, A copy 
of the instrument is presented in the appendix. 

The two courses, EI>-R 592 and ED-R 592A, include as objectives the 
sets of competencies one to four and five throu^ seven, respectively. If 
participation in these courses has an effect on student learning, it would 
be expected that . the average self-assessment rating in December would be 
greater than the average self -assessment rating in October, An examination 
of Chart G reveals that substantial average gains for conpetencies one 
through seven did indeed take place- 
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^ CHART G 

ABE Participant' Self-Assessment of Competencies October 1, and December 10, 1975 



Competency Pre-assessment Post-assesanent 

Number Mean 1 .2 3 4; 5 Mean 

1 2.6 V. ' \ . 4.3 

2 3.1 ^ > 4.4 

3 3.0 . [ 4.3 

4 2.4 <r J- . 4.3 

5 2.9 ^^^^ <^ 3.8 

6 2.1 <^ \ 3.9 , 

7 2.6 ' ^--^^ y 4.1 

8 3.4 j 4.0 

9 3.4 / !• 

10 3.2 f \ 

11 3.1 y 4.0 

12 2.7 /"^ 3.3 

13 2.6 ^ \ I 3.1 

14 2.7 3.0 

15 2.0 -"^C...^.^^^ 3.5 

16 3.2 3.7 

17 2.9 ^ 3.7 

18 2.4 '^C.^..^^^<r 3.2 ^ 

19 . 3.4 , ^^'^V 3.8. 

20 3.5 , ^-^ 

21 2.7 ^^--^^^^^^^"^ 

22 2,0 <r 2.5 

23 2.0 X^^^ ^ 2.9 

24 2.5 2.8 

25 3.1 

26 V 2.8 ^ '''^ ^ 3.6 



Mean of means 2 . 77 . Mean of means 3 . 61 
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At the beginning of the first two core courses, m~R 592 and ED-R 592A, 
participants were also pretested to obtain baseline data w^ich wuld later 
be compared with posttests to discern the amount of information gained 
during the course. A fifty item objective type examination was administered 
in the course ED-R 592. The average scores and standard deviation on the 
pre and posttests are given below. 

\ ED-R 592 „ Pretest Posttest 

>feafl 36.1 36.3 

Standard Deviation 3.3 3.3 

These data reveal that as a group, the participants did not maJce substantial 
gains on the posttests. The standard deviation indicates that on both the 
pretest and the posttest the dispersion of scores was equal , and scores 
clustered closely about the mean. 

Hie instructor of this course also made an item analysis of the diffi- 
culty levels of the pretest items. For the 27 participants who took the 
test, it is necessary that fourteen subjects fail an item in .order that it 
rnight fall clearly into the category of being one of the more difficult 
items (less that 50 percent correct). A tally of the number of wrcmg re- 
sponses to each item reveals that of the fifty itans included in the test, 
only 8 items fall into the category -of having less than fifty percent cor- 
rect responses, although several closely approximate the 50 percent level. 
Since these results are based on analysis of the pretest items only, one 
must assume that one reason for the lack of gain in average scores on the 
posttest may be the relatively large number of easy items on the pretest 
which caused an inflated beginning ax'erage score. Ihe instructor is to be 
conmended for his detailed itan analysis procedure, and it is suggested that 
either an alternative instrument be utilized for evaluating the progress of 

/ 
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students in futia-e offerings of this course, or the present instrument be 
revised, particularly since infonnation presented previously in Charts F 
and G indicate that participants have indeed derived much benefit from this' 
course. 

In the course ED-R 592A, an essay type examination was given to test 
students^ ability to apply concepts and skills to particular situations. 
The average scores and standared deviatiois on the pre and posttests are 
given below. 

ED-R 592A Pretest Posttest 

Mean 29.6 88.9 

Standard Deviation 26.4 8.2 

These data reveal that the"^ participants made substantial gains in average 

scores on the posttest, and gains were consistent across all items. The 

standard deviations indicate that the students^ scores were dispersed over 

a wide range on the pretests, but on the posttests the scores clustered 

much more closely about the mean. In view of the substantial increment in 

the poj^ttest mean, this result indicates that the group as a vtoole made 

large gains, rather than just a few individuals. 

In order to make an objective appraisal of participants* attitudes 

toward particular educational experiences that are provided, a general 

attitude scale was administered periodically, (The use of this scale will 

be further explained in Chapter IV; a copy of the instrument is given in 

the appendix.) The 20 item attitude scale was administered to participants 

in the courses ED-R 5^2 and ED-R 592A to discern their reactions to resource 

c 

persons who took part in the instructional program. Scores on the scale 
range fron 1.13, highly favorable attitude to 10.89, hi^ly unfavorable 
attitude. 

44 . 

33 " • 



The average scores given by participants to six resource persons are 
presented below in order of rank from favorable to unfavorable. On the 
scale of approxiJTjately one to eleven, a score of six represents the tran- 
sition point from the voove favorable to the more negative reactions to the 
experience. Five of the six resource persons fall into the more favorable 
category . It is therefore su^ested that the Project Director coisider 
these results in integrating resource persons into the succeeding coui^s 
offered in this program. 

Rank Average Scores 
^ . 1 2.78 

2 3.41 

3 3.68 
.4 4.12 

5 _ 4.55 

6 7.46 

During the winter intersession of 1976, the elective course ED-R X506F 

vjBS evaluated. The instructor asked students to rate three categories of 

course effects: knowledge and skill, enthusiasm for the field, and worth 
/ ... 
of the course to the individual, both personally and professionally. The 

ratjjigs are given on a nine point scale from 1 to 9, ^^toere one is the lowest 

rating, nine is the highest and the median rating is 5. The mean ratings 

by the total class are given below. 

Mean Kfean 
N Before After 



Prior knowledge or skill 33 3.6 6.9 

Enthusiasm for the field 33 5.6 8.1 

Value, personally 33 7.6 

Value, professicMially 33 7.9 
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The mean ratings revea^ that after taking this course the participants, 

as a group, report increased knowledge and skill, as well as a greater 

. . ■ / 

enthusiasm for the field of group dynamics. Hieir attitude about the worth 

of the course personally and professionally was very positive- This posi-- 

. / ■ • / 

tiv^ attitude was also expressed in the helpful suggestions for inprovement 

and the extensive written corrments that were included on the evaluation' 

sheets. It is apparent from the ccnments v*iich were expressed that the size 

of the class may be too large for this tj^e of course and the period of 

time allocated to instruction may be too short. Ccaisideration should pe 

given to making appropriate changes. 



/ 



/ 

/ 

/ ' ■ / 
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FIROT CYCLE OF EVALUATION: SUMMAEY OF ASSESSJ^ENT OF PROGRAM ELEMEOTS 



Within Chapter III the elements of the ABE project \^*iich were designed 
and inplemented have been described, and particular attention was given to 
the core courses. It was expected that the evaluation procedures would pro- 
vide iJiformation about aspects of the courses vixich could lead to subsequ^it 
revision and improvement of the on-going programjas well as evidence of 
possible course effects on leam-iag outcomss. Both kinds of infoimation have 
been presented at appropriate points^ the chapter. In addition, ^e evalua- 
tion process ha. 5 spawned a wealth of znfoiroation fron students, vihxch includes 
specific sugges- ions for inprovanent . Since suggestions may be difficiiLt to 
implement and sx::ce reactions from student to student may sometimes ccmf lict , 
it remains for the individual instructor or the staff as a vAK)le , to sift 
through this information and weigh the reactions and suggestions. In the 
light of their expert knowledge and ejcperience, and with concern for the, total 
situation, maribers of the staff may then formulate appropriate modifications. 

Hie descriptive data which havejbeen presented, the evidence concerning 
the internal consistency of the prc^am and the statistical and qualitative 
data can only lead to the jud^nent that 1) a program of high quality has been 
designed and 2) the courses which hav?? been inplemented and evaluated have 
been successful in promoting considerable growth toward the designated course 
competencies. Within a relatively short period of time the project staff has 
constiiacted and inplonented a viable and innovative instructional program;, its 
members are to be comnended for their diligence and creativity, \, 

i 
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Assessment of Program Elements: Second Cycle of Evaluation 

In two previous parts of this chapter, Sections A and B, descriptions 
were given of the program conponents ^^4lich were developed and assessments 
were made of the courses ^ich were taught as of the data of the Interim 
Report which was submitted on oanuary ^5, 1976. Section C of Chapter III 

will be concerned with an assessment of the remaining courses which wet^ 

■ / 

offered during 1976. In addition ro the descriptions of the thre^ dore 
courses, EE^R 592B, ED-R 592C, and 592D, which have already been pres--. 

anted in Section A, the reader may recall that mqlre intensive analyses were 

/ 

also made and discussed. The purpcse of the analyses was to discern the 
extenc to which program goals, course conpetenc|kes, and cour^ content 
vere adequately interrelated within these three courses. On/ the basis of 
evidence derived from the examination of the three course outlines prepared 
by the instmactors, the validity and viability of each of these courses as 

instructional media are clearly established. : / 

/ / 

At the end of each of the cour-ses an evaluation form was also conpleted 
by the students , in order to ascertain the internal consistency of course 
elOTents as perceived by students. Iliis information; is given in Chart H. 

An examination of this chart reveals that for each of /the courses, ED-R 592B 

'■' / 

and ED-R 592C, and for each question within these courses the students' 
responses were overwhelmingly in the affirmative. Students report that the 
conpetencies were logically linked to the course goals, and the instructional 
conponents and evaluation procedures were well suited to promoting growth 
toward achievement of the carpet encies. Virtually all participants indicated 
that they were able to implement in their respective classrooms the informa-* 
tion, skills and materials which they had derived from these courses. 
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CHART H 



Perception by Stuilents of the Internal Consistency of Elements, 
responses by coin^se. 


Talley of 


. 1. Are the course conpetencies related to the broad goals of the project? 


ED-R 592B 


Yes 23 


No 0 


No T*piQrv^n GO 


0 


ED-R 592C 


Yes 23 


No 0 


or unclear 
No response 


0 


ED-R 592D 


Yes 18 


No 2 


or mclear 
No response 


1 








or unclear 




2. Was the instruction related to the conpetencies? 






ED-R 592B 


Yes 23 


No 0 


No response 


0 


ED-R 592C 


Yes 21 


No 1 


or unclear 
No response 


1 


ED-R 592D 


Yes 15 


No 6 


or unclear 
No response 








./ 


or unclear 




1 — — ■ — — — ■ — ■ ^ — 

3. Were the evaluation procedures used in the coua-se related to the conpetencies 
and goals of the program? 


ED-R 592B 


Yes 22 


No 1 


No response 


0 


ED-R 592C 




No 0 


or unrlv-ar 
No response 


2 


ED-R 592D 


Yes 17 


No 1 


or unclear 
No response 


3 








or unclear 




4. In your teaching, 
received in this 


have you been able to inplement the instruction that you 
coiirse? 


ED-R 592B 


Yes 23 


No 0 


No response 


0 


ED-R 592C 


Yes 19 


No 0 


or unclear 
No response 


3 


ED-R 592D 


Yes 10 


No 8 


or unclear 
No respcflise 


3 








or unclear 





A considerable amount of anecdotal data was also provided by students 
as a rationale for their statements. It is not possible to quantify this 
information but as was true in the first cycle of evaluation, ,the tone of 
the responses was positive and continued to be very enthusiastic. Unfortu- 
nately on many of the evaluations in ED-R 592B and ED-R 592C student responses 
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were not anonymous. While it may appear to be in order to interpr~ this 
information with some caution, the over\^iieljniTig enthusiasm shown ::Dr 
these courses is indicative of sincere support. In addition these evalua- 
tions are consistent with twD additional assessments of the instrucrror and 
of the course which were made separately and anonymously. Additional 
statistical information about these courses will be presented in Chapter IV. 

It does not appear that participant responses were coerced. Erudents 
had been notified that they need not put their names on the evaluation 
sheets if they did not want to. The names on the sheets merely served to 
aid in identifying those individuals whose evaluations were not yet sub- ^ 
mitted. It is recornnended, however, that future evaluations follow the 
standard practice of anonyrnit of resv>onse. 

Chart H also includes information concerning the internal consistency 
of elements of the course ED-R 592D, ?ieldwork in Adult Basic Education. 
For this coin-se the majority of student responses for each question are 
also quite positive, but there are sufficient non-positive and unclear 
responses to suggest that some attention should be devoted to discussing 
areas of needed change. Most fieldwork courses involving outside agencies 
present vexing problems because the university has little control over the 
many variables and interactions involved in the field experience. Hence 
considerable coordination of effort may be required. There is no doubt 
that the observations of the instructors of this course combined with some . 
of the relevant anecdotal information supplied by the participants in 
their evaluations could help reduce some of the difficulties encountered 
by a few students. 
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In addition to the analyses of courses and the assessnient based upon 
student percepricais of courses, expert judgments were made by '^outside*' 
observers based .pen visitation of classes, discussions with participants 
and visits with the project staff. As a result of the first cycle of . 
evaluation, the two observers prepared a report consisting of a set of 
general conments, concerns, and specific recomnendations for inprovement . * 
Ihe intent of the report was to provide su^estions for iirprovement v^ich 

could be introduced inmediately into the program and thus iiicrease the 

■ / 

effectiveness of the project. 

Based upon their later observations during the spring and suniner of 
1976 the observers report that their siiggestions were indeed utilized in 
modifying the program. Edited excerpts from their report dated Septerrber 17, 
1976 are given below. 



Item 

1. The candidate selection 
process and procedures. 



Hie facilities and equip- 
ment. 



Review of initial course 
outlines to clarify objec- 
tives. 



Disposition 

1. From review and discussion it was 
deteimined that the selection pro- 
cedures as previously reconinended 
did consider geographic area, ex-- 
pressed needs and inrplications of 
futiare application by candidates. 
Ihese wsre incorporated tn 1976-77, 

2. The previous recorrmendations to 
provide permanent classrooms with 
availability of teaching equipment 
were identified as having been met 
for 1976-77. 

3. This was conpleted. 



4. Review of the program design 4. This determination is pending from 



to determine if internship 
of candidates could be pro- 
vided during the Fall or 
Spring terms. 



study and experience during 1976-77. 



*A copy, of this report is on file at the project office. 
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5. The question of whether 5. This determination is pending from 
optional intern activities study and experience during 1976-77. 
(in lieu of teaching) is 

possible or appropriate. 

6. Consideration of the ''two 6. The present project design allows 
track'' system-Basic Subjects for experiences in both and/or 
and ESL. enphasis in one of the areas. No 

change is deemed necessary. 

Within each course the instructors themselves have been making changes 

as the course progressed based upon both formal and infonnal periodic 

assessments. End of course assessments were also made for the pupose of 

improving future courses. The following set of notes concerning ED-R 592C 

is illustrative of the evaluation of courses, although most inprovements 

were made without written notification to the evaluator. 

Students' Prior Knowledge of the Subject Matter 

On the pretest adninistered to the 25 students, there was 
indication that the students were very limited in their knowledge 
of teaching reading to adults. From their pretest scores, from 
conments they made on the pretest, from a preliminary survey of 
their needs, and from conferences with the students early in the 
. semester, we were able to confinn their limited lack of knowledge 
in this area. It was also evident that their need for this 
course was dire. In view of this, a decision was made to modify 
the second year sequence 6f core coarses, offering ED-R 592C 
(Teaching Reading to the ABE Student) in the fall semester and ^ 
ED-R 592A (Teaching ESL to Adults) in the spring. 

Course Content ' 

The content of the course was designed to meet the needs of 
the participants. Wherever possible hi^ priority waB given the 
topics stressed as needed most by the students and as early as 
possible in the course. The course outline was, therefore, de-- 
ve loped to cover the many areas included in the four conpetencies 
for the course. — . 

Texts 

There was no available text in the field. I therefore \ised 
a short book edited by Joseph Mangano and published by I.R.A. , 
supplemented by readings from journals, books and handouts written 
or adapted by the instructor. There is a great need for a good 
text in this field. The instructor has consulted with other pro- 
fessors of adult education regarding the possibility of publishing 
a text on teaching reading to adults. 
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Activities 

Based on feedback from our first semester core classes, we 
used limited lecture and considerable student reports on selected 
or assigned topics. Ibis method was very effective because it 
Involved the students totally. It lent itself to discussicxi and 
further research. The instructor augmented the seminar topics 
with resource materials, audio- visual presentation, mini lectures 
and handouts. 

Mid-semester Evaluation 

For this class I.iised the mid--semester evsLluation form 
devised by the evaluafor. I found it acceptable in generating 
feedback from the participants. Little modification was indi-- 
cated but ^^ere it was possible changes were. made. 

Guest Speakers ^ 
There were several guest speakers Invited to speak on 
relevant topics. The speakers came well infoimed and all were 
rated rather hi^ on the attitude scales. We plan to use some 
of the same resource people again, as well as others. 

Length of Class 

The class was held in 10 sessions of 4 hours each. This, 
however, was hardly sufficient time for the covering of the 
course content. It was necessary to add an extra class meeting 
for the final exam and evaluation. There was surprisingly 
little objection on the part of the participants. 

Note:. Two students withdrew from both Spring semester courses 
and from the program due to medical and personal prob-' 
lems which made it inpossible for them to keep up their 
<^uj;59ework. 
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SECOND CYCLE OF EVALUATION: SUMMARY OF ASSESSMENT OF PROCaRAM ELEMENTS 

During the second cycle of evaluation, elements of the ABE Project vAxich 
were iiiplemented during 1976 have been described and assessed. The descrip- 
tive data which have been presented, the statistical evidence concerning the 
internal consistency of the program, and the connents from students lead to 
the judgment that the high quality of the piogram has not only beei maintained 
but has even iirproved. At appropriate points in tbo analysis and discussicaa 
of courses the evaluators have made reconmendations ^ich'the staff may wish 
to consider. 
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CHAPTER IV 

PRESENTATICN AND ANALYSIS OF DATA RELATED TO OUTOOMES 

Whereas in Chapter III, attention was devoted primarily to description 
and assesanent of the program wiiich was actually iirplonented , the present 
chapter will focus on presentation and analysis of data to discern growth 
toward objectives. Since , standardized tests were not available, instruments 
were either developed locally or acquired from other persons who are interested 
in training adult basic educators. -These instruments are listed below: 

1. Assessment of Conpetencies, a survey checklist to acqxiire the 
participants » a) perception of his own needs b) report of the 
percentage of competencies (the participant's needs) met by 
the program. 

2. Course tests, instnjments developed by instructors for use in 
their respective courses. 

3. General Attitude Toward , a smvey checklist to acqxiire 

the opinions of participants concerning the relative worth of 
particular educational e?cperiences . . 

In addition, the staff provided judgments about the number and percentage of 
participants who met the criterion level of performance. 

Within section B pf Chapter III an analysis was made o^ the participants' 
self -assessment of canpetencies in adult basic education as of the date of 
pre-assesaiient on October 1, 1975 and the end of the semester in December, 
'nais information was presented in Chart G. The baseline data obtained in 
October, 1975 may also serve as a basis for making ccmparisons of students* 
acccnplishments at the end of the program in the summer of 1976. If partici- 
pation in the ABE pix^gram has an effect on student learning, it would be 
expected that for each of the several competencies, the average self -assessment 
rating in August, 1976 vrould be greatet than the average self-assesanent rating 
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in October, 1975c Ihe pertinent information is presented as Chart I. An 
examination of Chart I reveals that average gains for all ccni>etencies djd \ 
indeed take place. Qti a five point scale, a ratiiig of three is average. It 
can be observed in Chart I that for the pre-assesanent , the average gxx>\xp 
rating was below three on sixteen of the twenty-six corpetencies, Oa the re- 
maining ten caipetencies, there were no group average ratings above three point 
five (3.5). Qi the post assessifnent in August, 1976, the average in the ratings 
for each coipetency were all above three. Twenty-three of the averages were 
above four. According to the self reports or the group as a whole, substantial 
inprovement has taken place, 
/ There wei , of course, individual differences within the groiips in the 
degree of jjiprovement \^ich occurred with respect to each conpetency. The 
staff may wish to examine the data more closely to try to detect any Ihdividual 
course or demographic characteristics vtoich may be associated with the low growth 
segnients of a few profiles. In addition, the staff may wish to e?ramine more 
closely the several coipetencies for ^rtiich the grovap averages on the post 
assessjtient were at or below 4,04. Ihese are numbered, respectively, 13, 18, 
21, 22, 23, 24, 25 and 26, Ox virtually all of these conpetencies , the beginning 
averages are very low. With regard to those conpetencies for v*iich the gains 
were l^II the staff may wish to discuss possible iiiplications Snd take appro-- 
priate action. 
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CHART I 

ABE Participant Self-Assesanent of Competencies October, 1975 and August, 1976 



Corpetency 
Nlmiber 

1 

2 

3 

4 

5 

6 

7 

8 

> 9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 



Pre-assessment 
Maan 

2.6 

3.1 

3.0 

2.4 

2.9 

2.1 

2.6 

3.4 

3.4 

3.2 

3.1 

2.7 

2.6 

2.7 

2.0 

3.2 

2.9 

2.4 

3.4 

3.5 

2,7 

2.0 

2.0 

5 

3.1 
2.8 




Ebst-assessrent 
.5 Mean 

4.69 

4.91 

4.60 

4.60 

4.09 

4.30 

4.39 

4.49 

4.87 

4.60 

4.35 

4.50 

4.04 

4.35 

4.26 

4.43 

4.69 

3.91 

4.69 

4.39 

4.04 

3.17 

3.74 

4.01 

- 3.87 

4.00 



Mean of means 



2.77 



Mean of means 



4.31 
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For virtually all of the courses that were offered, the participants had 
an opportunity to indicate their individual perceptions of the contribution of 
a given course to their own growth by caipleting a short rating scale. Ibr 
each of four categories of response there is a nine point scale on v4iich a 
rating of five is average. At the end of the course the participants recollected 
and checked their position on a scale at the beginning of the class and at the 
end of the class with respect to the categories, Prior Knowledge or Skill and 
Enthusiasm for the Field. In addition, the participants checked their percep- 
tion of the value of the course personally and professionally. 

Ihe averages for the group in each category of responses are presented in 
Table 1. In order to facilitate canparisons and interpretations the group 
averages are ranked frcxn high to low in Table 2. The purpose of the rarikings 
is not to compare one course with another but to provide infonmation about 
individual courses ^^*lich should be looked at nore closely. In addition, this 
information might be used in interpreting other coiu-se data. For exanple, 
coluims 4 and 8 of Table 2 show that the course EI>-R 592D obtained the lowest 
rankings for average growth, respectively, on knowledge or skill and in 
enthusia^ for the field. But for both of these categories the course ranked 
first at the pre-entry level. The relatively high level at which participants 
believe they entered this course may partially explain their relatively low 
rankings of the course both personally and professionally. Further, this 
infoimation may shed some light on their attitudes toward the internal 
consistency of this and other courses wtiich are described in Section C of 
Chapter III. 

The group averages in Table 1 also show that the students feel that eadi 
of the courses was of value personally and professionally and contributed to 
growth in knowledge or skill and enthusia;3n for the field. With regard to 
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knowledge or skill, the average pre-entry ratings for all courses but ED-R 592D, 
was below the average rating of five. For all courses the end of course aver- 
ages In ratings was above five. As mi^t be expected with regard to enthusiasm 
for the field, the average pre-entry ratings for all coiu^s were at or above 
the average rating of five, but nevertheless, growth in enthusiasm was reported 
for each course. With respect to the value of each course personally and 
professionally, the average ratings for each course was above the average rating 
of five. On the basis of the infoimation which is presented above, it must be 
concluded that the students believe that the courses were successful in contrib- 
uting to their growth in all of the categories under consideration. 
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TABLE 1 



Participants' Perception of Course Contributions to Growth 

Number Mean Mean Chaa p'*=^ 

Before After 

Prior Knowledge Or Skill 
Core Courses 



JCiU— it ObTid 


23 


4.1 


6.2 


2.1 


EI>-R 592A 


26 


3.6 


6.8 


3.2 


ED-R 592B 


23 


3.8 


7.8 


4.0 


ED-R 592C 


23 


3.7 


7.6 


3.7 


E[>-R 592D 


23 


6.5 


7.8 


1.3 


J4ini Courses 










•'ED-R X506A 










ED-R X506B 


22 


4.8 


6,7 


1.9 


ED-R X506C 


29 


4.5 


7.7 


3.2 


ED-R X506D 


16 


3.9 


6.2 


2.3 


ED-R X506E 


11 


3.6 


7.5 


3.9- 


ED-R X506F 


33 


3.6 


6.9 


^.3 
2.8 


ED-R X506G 


9 


4.2 


7.0 


ED-R X506H 


34 


3.9 


7.0 


all 



**ED-R X506J 
**ED-R X506K 
Enthusiaan For The Field 
Core Courses 



ED-R 592 


23 


6.5 


7.0 


0.5 


ED-R 592A 


26 


5.0 


7.0 


2.0 


ED-R 592B 


23 


5.7 


8.7 


3.0 


ED-R 592C 


23 


5.6 


8.3 


2.7 


ED-R 592D 


23 


7.f- 


7.8 


0.7 
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TABLE 1 OCm'IISTO 



Mini Courses 



♦EI>-R 

ED-R 
ED-R 
ED-R 
ED-R 
ED-R 
ED-R 
ED-R 
**EI>-R 
**ED-R 



X506A 
X506B 
X506C 
X506D 
X506E 
X506F 
X506G 
X506H 
X506J 
X506K 



Value of Course 
Core Courses 
ED-R 592 
ED-R 592A 
ED-R 592B 
ED-R 592C 
ED-R 592D 
Mini Courses 
*ED-R X506A 
ED-R X506B 
ED-R X506C 
ED-R X506D 
ED-R X506E 
ED-R X506F 
ED-R X506G 
ED-R X506H 
**ED-R X506J 
**ED-R X506K 



Number 


Mean 


Mean 


Chajig 




IJC' J. VJX ^ 


rUL Lc^X 




29 




i .ft 






D . O 


ft *^ 
O • *3 




16 


5.7 


7.3 


1.6 


11 


5.4 


7.9 


2.5 


33 


5.6 


8.1 


2.5 


- 9 


6.3 


8.2 


1.9 


34 


6.2 


7.5 


1.3 



Number 



23 
26 
23 
23 
23 



22 
29 
16 
11 
33 
9 
34 



Personally 



5.3 
7.0 
8.3 
8.3 
6.6 



7.5 
8.0 
7.5 
8.4 
7.6 
7.9 
5.6 



Pro f ess i onal ly 



7.0 
7.5 
8.9 
8.4 
6.5 



7.7 
8.4 
7.2 
7.6 
7.9 
8.0 
7.0 
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Participants' Perception of Course Contributions to Growth, Rank Order of Courses and 
Group Averages. 



Knowledge or Skill 


Enthusi-aan For Ihe Field 


Value Of Course 


Averag 
Course 


eAt 
Entry 


Average 
Growth 


Average At 
Coarse Entry 


Average 
Growth 


Personally 


Professionally 


1 


2 


3 


'4 




5 


6 


7 




q 


in 


IX 


19 


592D 


6.5 


592B 


4,0 


592r 


7.1 


592B 


3 0 








9, Q 

0.17 


506B 


4.8 


506E 


3 9 




6.5 


592C 


2 7 


592B 








506C 


4.5 




3.7 


506G 


b.o 


506C 


2.5 


592C 


8.3 


50ftC 


8.4 


506G 


4.2 


506P 


3.3 


506B 


6.2 


506E 


2.5 


506C 


8.0 


506G 


8.0 




A 1 


592A 


3.2 


506H 


6.2 


506F 


2.5 


506G 


7.9 


506F 


7.9 


506D 


3.9 


506C 


3^2 


506C 


5.8 


592A 


2.0 


506F 


7.6 


506B 


7.7 


506H 


3.9 


506H 


3.1 


592B 


5.7 


506G 


1.9 


506B 


7.5 


506E 


7.6 


592B 


3.8 


506G 


■ 

2.8 


506D 


5.7 


506D 


1.6 


506D 


7.5 


592A 


7.5 


592C 


3.7 


506D 


2.3 


592C 


5.6 


506H 


1.3 


592A 




/ 

■ 506D 


7.2 


592A 


3.6 


592 


2.1 


506F 


5:6 


506B 


1.2 


592D 


^6^6 


592 


7.0 


506E 


3.6 


506B 


1.9 


506E 


5.4 


m 


0.7 


506H/ 

/ 

592 


/ 

5.6 


506H 


7.0 


506F 


3.6 


592D 


1.3 


592A 


5.0 


592 


0.5 


5.3 


592D 


6.5 



/ 



The analysis in the two previous sections of this chapter are concerned 
with the growth of students in the conpetency and in the relative contributions 
of the respective courses to growth as perceived by tl^ participants themselves. 
The next section will be concerned witn student growth as measured by pretests 
and post tests. 

At the beginning session of each of four core courses participants were 
pretested to obtain baseline data ^ich could later be cotipared with posttests 
to provide information about the amoiont of growth which took place.* These 
data are presented in T'^le 3. An analysis of Table 3 reveals that -for three 
of the four core courses, EB-R 592A, EI>-R 592B and ED-R 592C, the participants 
made substantial gains ir; average scores on the posttests. The standard 
deviations indicate that the students* scores were dispersed over a wide range 
on the pretests, but on the posttests the scores clustered much more closely 
about the mean. In view of the substantial increments in the posttest means 
and the decrease in size of the standard deviations, these results indicate 
that within each course the group as a Vfhole made large gains, rather than just 
a few individuals. The apparent lack of growth in course ED-R 592 is probably 
due to deficiencies in the testing instrument. The reader may wish to review 
a discussion of this problem in Section B of Chapter III. 
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*Pre tests were not appropriate for ED-R 592D. 
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TABI£ 3 

A^ge Scores and Standard Deviations on Pretests and Ibsttests in Designated 



Pretest 



Posttest 



Core 
Courses 

ED-R 592 
ED-R 592A 
ED-R 592B 
ED-R 592C 



Mean 

36.1 
29.6 
39.8 
25.4 



Standard 
Deviation 

3.3 
26.4 
13.8 
14.0 



Mean 

36.3 
88.9 
96.2 
92.3 



Standard 
Deviation 

3.3 
8.2 
2.9 
7.7 



Change 

00.2 
59.3 
56.4 
66.9 
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In part B of Chapter III, an attitude scale vas presented \*ich seeks 
to discern participants' attitudes toward particular educational experiences 
that are provided. In the interim report the use of this scale was devoted 
primarily to the assessn^nt of resource persons who were involved In the 
OBstructional program. The theory upon which this scale is based will be 
discussed next, and a presentation of the results derived from a broader 
application of the scale will follow. 

In order to make an objective appraisal of the total program a general 
instrument is needed which does not depend primarily upon specific reactions 
to single aspects of an educational activity. A more general assessment 
instrument may pemit canparisons to be made between two or more different 
types of activities when content and process may vary and, in addition, give 
an objective measure of the total program. Therefore, the instrunent needs 
to measure elements cannon to any educational activity.* One cannon element 
is the general attitude of the participant at the conclusion of an organized 
educational experience. Tlie attitude scale should measure the reaction of a 
total group to an organized educational activity in order to assess its success 
from the viewpoint of its participants. However, since the groups may vary in 
composition and since the scales are administered to participants at different 
time periods during the course of the program that is being evaluated, minor 
differences in average scores and rankings should be interpreted cautiously ^ 
particularly since the nature of the content does indeed vary from one activity 
to the next. 



* S!?? P instrument was scientifically developed at Florida State University 
Tallahassee, by professors Russell A. Kropp and Coolie Verner who generously 
provided the writer with a cx»py. a ^ 
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The average scores given by participatits to the several core and mini 
courses are presented in Table 4 in order of rank, Ihe lowest score repres^ts 
the most favorable reaction. Qi a scale of appitDximately c«ae to eleven, a score 
of six, the median value, represoits the transition point from the more favor- 
able to the more negative reactions to the experience. It may be observed 
in Table 4 that all of the core courses and all of the mini courses fall into 
the more favorable category, 

TABLE 4 

Rank and Average Scores from Surveys of General Attitude Toward Educaticmal 
Experiences: Designated Courses 



Rank 


Core Courses 


Average Scores 


1 


ED-R 592B 


2.61 


2 


ED-R 592C 


3.06 


3 


ED-R 592A 


3.08 


4 


ED-R 592 


3.99 




Mini Courses 




1 


ED-R 506C 


2.99 


2 


ED-R 506D 


3.43 


3 


ED-R 506G 


3.63 


4 


ED-R 506B 


3.89 


5 


ED-R 506H 


4.39 



The relatively high mean score \'alue given to all of these coursSes seems 
to be indicative of highly positive feelings among participants toward the 
kinds of experiences which they have been given and is an indication of the 
worth of these experiences to than, personally and professionally. 
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The average scores given by participants to resource persons and other 
educational experiences are presented in Table 5. The order of rank again is 
from the more favorable to the more negative with a score of six representing 
the transitional point to the more negative reactions. It can be observed 
that thirteen of t:ie fourteen experlen-es fall into the favorable category. 
This is an exceptionally fine record. The students as a group seem to find 
much merit in the educational experiences. The educational experience which 
ranks fourteenth has already been deleted from the program. 



TABLE 5 

Rank and Average Ratings from Surveys of General Attitude Ibward Educational 
Experiences: All Other Non-course Categories. 



Rank 


♦Experience 


Average Rating 


1 


1 


2.78 


2 


G 


2.90 


3 


C 


3.01 


4 


H 


3.20 


5 


E 


3.25 , 


■6 


2 


3.41 


7 


B 


3.54 


8 


F 


3.62 


9 

10 ' 

11 

12 

13 

14 


3 
A 
D 
4 
5 
6 


3.68 

3.82 

3.92 " 

4.12 

4.55 

7.46 



*Most of the educational experiences involved resource persons whose naites 
are being held in confide ice. 
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Two courses which were offered have not been previously analyzed or- 
discussed, EI>-R X506J and ED-RX5G6K/ For the course ED-RX506J, very little 
infomiation is avaiilable upon which to base an evaluation beyond the course 
outline and a few written conments by four students. The course outline is 
conprehensive and the student ronarks are positive. However, it is suggested 
that in future offerings the instructor of this course provide the same type 
of evaluation d£tta that is characteristic of the other courses. If this 
procedure is followed, the course can be observed and assessed as part of the 

j 

total program. . . ^ • . 

The course ED-R X506K is a special course with a unique foimat that is 
^ open to a broad range of participants with diverse backgrounds. Considerable 
Oi^aliiative ckita is available for this course which leads to the judgynent that 
it was qtiite successful in achieving its objectives. All resource persons were 
rated highly by the participants. Since this is a course with a lanique format, 
it is reconnmended that future offerings continue to be evaluated using the 
same general procedures. One evaluation form, however, may need some minor 

changes. rs 

• . ■ w , . 

One of the objectives of the ABE project is stated as a criterion to be 
achieved: Having received training in this program, the participant will 
demonstrate that he has found the program personally and professionally valu- 
able in at least 80% of the catagorles listed on, the program evaluation form. « 
•n^ reader will recall from the previous discussion in Chapter III of Chart G 
that there are 26 ccnpetencies to be achieved. On the pre and post ' assess- 
ments, the participants were asked to rate their achievement of each competency 
on a five point scale, ""a rating of 1 is low, 5 is high, and 3 is an average 
rating. It is judged that the program is perceived by the students as per- 
sonally and professionally valuable if on the post assessment he gives himself 
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a ruling of 3 or higher on the given canpetency. 

The numbev and peroentage of participants wte attain the 8W criterion 
. perfoi^nce level Is given in Table 6. achieve this level of, success a 
sell-rati^g of 3 or above on 21 c^tencles ™,st be given by each student 
lV.„ty-t» students or 96 percent rited tha^lves as having achieved twenty- 
one canpetencies, a,e student did no't. In view 'o, the preponderance of ^ 
P»tlcipa„ts Who achieved the p^rfox^nce level, it is Judg«i that the p^gra™ 
achieved this criterion. 

TABLE 6 

;^e5^LSss^-SSa;*^t1S?(&^^^^ ^erfo^ance 



Attained 80% or nrare of 
Rrrogram Conpetencies 



Attained less than 80% of 
Program Competencies 



Nimber 



22 



Percentage 



96 



Total 



23 



100 
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The second objective of the ABE project which was stated as a criterion 
to be achieved anticipated that the project participants would demonstrate, 
conpetence on at least 80% of the program obejctives as judged by the instruc- 
tional staff. Since specific coirpetencies were involved in each course, the 
instructors , were asked to judge each student ^s performance with respect to the 
nuirber of competencies which were a/^hieved. Because there were 26 oot:5>etencies 
in all, a student attained the jcriterion if he achieved twenty-one. 

The number and percentage of participants viho attained the 80% criterion 
of performance are given in Table 7. To achieve this level of success 21 or 
more carpetencies must be attained by participants. Sixty-^five percent of the 
students (15) were rated as having achieved twenty-one conipetencies. lYiirty- 
five percent (8) did not. l^ne preponderance of participants achieved the 
established performance level but the percentage of the grotp that did not was 
approximately one third of the total group. This result reflects the fact that 
not all participants took all of the elective courses, therefore they did not 
have the opportunity to demonstrate to the fa^^ulty their conpetence in particu- 
lar areas. Nevertheless, the staff is challenged to improve on attainment of 
this objective during the second year of the operation of the project. 

TABLE 7 . ' 

Tlie Number and Percentage of Participants Who Attained the Criterion Perfonnance 
Level of Success. on Program Competencies (Instructors* Reports). 



Attained 80% or more of Program Competencies 
Attained less than 80% of Program Competencies 

Total 

71 
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Nurrfcer Percentage 

15 65 
8 35 



23 100 



In many nr )jects that are evaluated there are oftoi certain conconitant 
unanticipated ei facts that gc unnoticed because they were not planned for as 
program objectives. One concomitant side effect of the current project viiich 
has been observed is the degree, of professionalian v^ich ims been exhibited 
by the participants. While it was indeed an objective of the project to 
elevate the degree of professionalism among participants as Adult Basic Educa- 
tors, it was probably not expected that the participants wDUld thereafter 
perceive thanselves in thiv professional role of trainers of Adult Basic Educa- 
tion teachers. But such an effect has occurred! In answer to a request for 
Inforniation about how the current group might help in the training of the group 
of future participants, 19 of the 21 participants responded to this question. 
Of the 19 ^^o responded, 18 suggested ways in vftx±ch they might serve, for 
example, as speakers, demonstrators, consultants, master teachers, or conductors 
of in-service workshops. The pr»:"oect staff has therefore indicated its willing- 
ness to draw upon the talents ot the group and the participants have indicated 
their readiness to perform a professional teacher education role. 



' (The activity vAilch is the subject of this report was supported in whole or ir 
part by the U.S. Office of Education, Department of Health, Education, and 
Welfare. However, the opinions expressed herein do not necessarily reflect 
the position or policy of the U-S. Office of Education, and no official en- 
dorsement by the U.S. Office of Education should be inferred.) 
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APPENDIX TO EVALUATION REPORT 
Teacher Training Project in Adult Basic Education 



\ 



Illustrative Questionnaire - Internal Consistency 
Competency Self -Assessment Scale 
Attitude Scale 

Instructor and Coiu:se Evaluation 
ED~R X506K Evaluation Fonn 
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Teacher Training Project in Adult Basic Education 
California State University, Pullerton 



COURSE EVALUATION 

Fall Senester 19'75 

To the student: As a participant in the Teacher Training Project in Adult Basic 
liducation, your help is needed in assessing the course which you have just 
conpleted The project has as its broad goal to "provide teacher training and 
staff development in methodology of instruction appropriate to the needs of 
adult basic education students, particularly those with limited English speaking 
aDiiity and/or from limited economic and social circumstances," 

The specific competencies for this course ai'e: The student will be able to: 

1. Demonstrate his ability to explain the basic psychological laws 
affecting the adult learner. 

2. Demonstrate that he can identify the characteristics of the adult 
learner . 

3. Demonstrate his ability to analyze the strengths awd limitations of 
various methods and techniquas in teaching basic education courses 
to adults. 

4. Deronstrate his knowledge of professional organizations and resources 
available to the teacher of ABE. 



Please respond to the following questions. 

1. Are the course competencies related to the broad goals of the project? 
Yes No Please explain. 



2. Was the instruction related to the ccmpetencies? 
Yes No Please explain . 



ERIC 



74 



9 



' Were the evaluation procedures used in 
and goals of the program? 

Yes No Please explain. 



the course related to the conpetencies 



In your own teaching, how have you been able to inplement the instruction that 
you have received in this course? 



CSUF TEACHER TMNING PROJECT IN ADULT MSIC EDUCATION 
Assessment of Competencies 

Directions s Please assess your own competencies related to the following objectives in the 
Teacher Training Project in ABE, 



Scale: 1 2 3 4 5 ED-R 592 

Not Competent Highly Competent 

Please be honest in your ranking and specific in 

your comments. EO.r 



Objective 



Self Assessment 
(please circle) 

12345. 



Course// 
Date 



Course t 
Date' 



Coraent 



1. Demonstrate his ability to explain the 
basic psychological laws affecting the 
adult learner. 



Z. Demonstrate that he m identify the 
characteristics of the adult learner. 



3. Demonstrate his ability to analyze' the 
strengths and limitations of various 
methods and teachniques in teaching 
basic education courses to adults-, 



4. Demonstrate his knowledge of professioiaal 
organizations and resources available 
to the teacher of' ABE. 



5. Demonstrate that he can describe the 
English sound and syntactical system 
as it relates to the adal': learner with 
an ESL background. 



6. Demonstrate iliat he can assess, plan, 
implement, and' evaluate a program designed 
to meet the needs of the adult ESI student. 

"^-^ ^ 

7n 



12345 



12345 



1 2 3 M 



12345 



12345 



123 4 5 
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Objective Self Assessment Coinment 



7, Demonstrate the ability to identify, 
select and evaluate resource authors, 
texts ; and periodicals in the ESL field. 


1 2 3 M 




B. Demonstrate that he can assess and plan 
instruction based on the unique needs 01 
the linf^uistically different, culturally 
different and/or the economically 
disadvantaged adult. 


1 2 3 M 


0 


9. Demonstrate that he can adapt and develop 
apDropriate instructional materials relate 
to the life style and coping skills of 
the individual ABE student, 


1 2 3 5 

d,; 

/ 

* 




10. Demonstrate the ability to assist the 
ABE students m self-analysis appropriate 
to his life styles and coping skills and , 
in development with the student of ' / 
; techniques and resources needed for grow|l' 


123^5 




11, Demonstrate tha't he can design evaluation 
/ procedures nee(ied to show individual 
growth and progress development. 

/ ' . 
/ 


1 2 3 M 


• 


'U, Demonstrate that he can analyze and 

/ describe the/ causes of adult reading ' 
■ ' jf problems, , /' 


1 2 3 M 




13. Demonstrate that he can assess, diagnose 
//. arid prescribe' the reading needs of adults 
at the basic, functional and develop- 
mental levels. 


4 1 0 )i ^ 




li^, Demonstrate the ability to evaluate, 

select and organize facilities, materials 
rjn and equipment in an individualized 
'^j^^idin/^' program for adults. 


4 ^ ^ li K 

123^5 
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Ob jective 



Self Assessment 



Comment 



. authors, texts, periodicals and pro- 
fessional organizations in the field 
of teaching reading to adults, 


1 9 ^ li \ 




16, Demonstrate that he can synthesize 
the knowledge, training and experience 

frODl thp OOlr^ rnur^NP^ in thi^ Viropv^t^ 

and develop further professional 
expertise by using them effectively 
in a fieldwork situation, 


1 2 3 M 




•17. 'Demonstrate that he can design. 

implement, and evaluate inservi^e pro- 

l/CUUIco lcJ,Quyu .uU lliy VdilUUo 5IUUP0 

■affected by and affecting his program, 
such as students, aides, teachers and 
administrators. 


i 2 3 M 


J) 

1 


18. Demonstrate that he can understand 
ahd interpret the format and individual 
components of an ABE project proposal. 


1 2 3 M 


/ 


19. Demonstrate that he can develop jiiethods 
ana experiences J or aciuits wiii.cn wixi 
explain faiiiily money management, 
related to his rights as a consumer and' 
as a citizen, 


1' 2 3 M 




20, Demonstrate that he- can assess the basic 
computational skills of adults and 
develop individualized instructional 
plans for teaching the needed compu- 
tational skills in ways which relate 
these skills to daily survival and 
vocational needs, 


123^5 


V 



21. jiflmonstrate that he can establish, 
El^C'erate and evaluate an adult multi- 
.■ OT^dia, individualized' learning center, 



1.2 3 M 
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Objective Self Assessment ' Gomment 

0 '' ' ■ 



17. Demonstrate that he understands the 
-..nique problems of ABE physically 
;; mentally handicapped students and 
that hp can asspss. diagnose and 
prescribe for the reading ne'eds of 
these persons using appropriate 
■ techniques. 


1 2 3 ^[ '5 

\ 
\ 

\ ■ 




23. Demonstrate his ability to interpret 
furrpnt rp'^part^h in ABE and desifm 
and conduct a research project 
related to current trends and pro- 
jected research needs. 


1 2 3 M :, 




oh. Diimn ■ itrfltp that hp ran inpntifv 

implement, and evaluate techniques for 
teaching group dynamics and leadership 
skills to ABE students, 


12345 




9C flomnnctrQ+o that Via onn idpntifV. 

select, and evaluate materials^ 
used to prepare adults for the General 
'. Education Development test, 


■1 2 3 4 5 




26. Demonfitrate th^t he understands the 
background factors related to the 
Kaein oHi'ipati nnfll nppd<5 r-f the bil inffual^ 

adult le^er and that he can implement- 
a. program of teaching that will meet 
those needs', 


,1 2 3 M 
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GENERAL ATTITJDE TOWARD 

(Course, activity , or program) 



Listed below is a set of 20 statements which may describe your feelings in 
general toward the experience indicated above. The feeling tone of the 
statements ranges from the most favorable to the less favorable and most 
negative reactions. 

Read the entire list of 20 items carefully and then check ONLY those state- 
ments that describe most accurately your reaction to the TOTAL experience. 
You may check as many statements as you wish . 

NUMBER ITEM PLEASE CHECK 

1 It was one of the most rewarding experiences 
I have ever had. 

2 Exactly what I wanted. 

3 I hope to participate in another one in the near future. 

4. It provided the kind of experience that I can apply to 

ray own situation. 

5. . It helped me personally. 

6. It solved some problems for me, 

7. I think it served its purpose. 

8. It had some merits. - ; 

9. It was only fair. 

10. It was neither very good nor vei*y poor. 

11. I was mildly disappointed. 

12. It was not exactly \tot I needed. 

13. It was too general. 

14. ' I am not taking any new ideas away. ^ 

15. It didn^t hold my interest. > . 

16. It was much too st^rficial. 

17. I leave dissatisfied. 

1^^. It was very poorly planned. 

19. I didn't learn a thing. 

20. It was a corrplete waste of time. • 



EMC 



84 



DIVISION OF SPECIAL PROGRAMS - SCHOOL OF EDUCATION - CALIFORNIA STATE UNIVERSITY 

INSTRUCTOR AND COURSE EVALUATION 



Instructor's Name 



Course 



Date 



(Please Print) 

Please rate the instructor of this course by circling the appropriate number. 
A rating of 9 is highest, 5 is average, and 1 is lowest. 



Lowest Average Highest 



Knowledge of the field 

Overall teaching effectiveness 

Fairness of instructor's evaluation method 



1 2 3 
1 2 3 
1 2 3 



4 5 6 
4 5 6 



7 8 9 
7 8 9 



4 5 6 7 8 9 



Please rate the course's effect upon the following. Aqein a rating of 9 is 
highest, -5 average, and 1 is lowest. 



Your knowledge or skill in this field as compared to other fields: 



Before taking the co/jrse 
After taking the course 
Your enthusiasm tor the field: 
Before taking' l|ie course 
Afte r taking the course 
Value of the course to you: 

; 

(1) Personally / 

(2) Professionally 

YOU HAY MAKE ADDITIONAL COMMENTS BELOW: 



2 
2 

2 
2 

2 
2 



4 
4 

4 
4 

4 
4 



5 
5 

5 
5 

5 
5 



7 
7 

7 
7 



I; 



8 
B 

8 
8 

8 
8 



9 
9 

9 
9 

9 
9 
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ED-R X506K - ADULT BASIC EDUCATION TRA.INING INSTITLTTE FOR ADMINISimTCRS , CXXJNSEIJORS AND 
TIv\CHERS 



EVALUATl '. W K)RM 

This evaluation is to be retui-necl in the attached pre-^ddaessed 6»nvelope by June 25th. 
It is required In order to receive 1 unit of academic cred ' >. 'v the course. 

NAML; ^ .ilE 

TITLE OR POSITION 



Please thi'ik about what has happened in the weekend institute, /assess its value to 
you by checking the appropriate column. 

Yevy Fairly Not Already Not 

Helpful Helpful Enou gh Familiar Worthwfai le 

D r. Roger Axford 

Information presented 

Handouts _^ 

Ojjportunity for Audience Partjcij ation ^ 

J ohn Canper 

InfoiTTiation presented _^ 

Handouts ^ 

Oi:)pc)rtunity for Audie^nce Partici] ation 

C )UJisel in g Pane l_ 

Information presented 

Handouts 

Qpportunitv for Audience Pa rticif :ition 

rn- Dob Calvo 

In format io 1 pres'^^nted • 

Handouts 

Oioportunit / for Audience Part jci]) ition 

R ip Se.ssions wi :h'th£ Expert s 

Informatic 1 presented ^ ■ 

ILindouts J ■ - 

Opportunity for Audience Participation - ^ 



Please conplete the following statements, giving thoughtful consideration to your answers. 

1. The thing I liked most about the workshop ^\'as 

2. The thing I liked least about the workshop was 

3. IJlany participants _ 

4. llore people could have 

5. I W3uld have profited more if 

6. The speakers were 



7. Fewer people could have . 

8. A future weekend workshop 

9. ' It might have helped if I had 

10. The coordinator of the workshop 
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Please write an assessment of the session which concerned you most, explaining (1) 
the stated objectives of the presenter(s) , (2) the manner in v*iich the presenter(s) 
achieved the stated objectives, and (3) whether the session was successful in your opinion 
(giving specific reasons in your individual case). 



iPg§, Qther side if necessajy) 



How has this workshop changed your attitude or behavior? (Exaxiple, encouraged you to 
study or research a topic, dr> something different in yc, ir work. )_,^ 
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.. (Use other side if necessary) ^ 
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